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(57)Abstract: 

PURPOSE: To quickly and exactly move a screen to a 
designated position by inputting a gesture. 
CONSTITUTION: When the screen is scrolled, the 
gesture of a scroll is inputted to the position of the 
screen being the origin of movement with a pen 1 1 . A 
CPU 1 obtains the coordinate of the position at which the 
gesture is inputted by information from a transparent 
table 10, and recognizes the content of a scroll 
instruction by referring to a dictionary for gesture 
recognition provided in a dictionary 3. When the 
recognized result is, for example, the instruction to move 
the screen to a center, the coordinate of the start point of 
a new display area is searched from the coordinate of 
the point at which the gesture is inputted, the coordinate 

of the center of the present display area, and the coordinate of the start point of the present 
display area or the like. Then, moving processing, that is, the writing position is moved at the 
time of wnting document information held in an RAM 4 in a VRAM 6 according to the 
calculated result, and the result is displayed on an LCD panel 9. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the information processor of the pen input method 

equipped with the processing facility by the gesture input. 

[0002] 

[Description of the Prior Art] In recent years, information processors using a pen input method, such as 
a word processor and a personal computer, are put in practical use. A screen moves the screen-rolling 
function in the information processor using this pen input method towards the upper and lower sides 
which that scrolling key shows, or right and left by displaying the scrolling key which shows the 
direction of the upper and lower sides and right and left on the functional viewing area of a screen, and 
touching this scrolling key with a pen. 

[0003] Moreover, by recently, the approach by the gesture which scrolled the screen in the appointed 
direction is also considered by writing on a screen the gesture (an alphabetic character, a notation, etc. 
which were set up beforehand) which shows the upper and lower sides and the longitudinal direction 
corresponding to a scrolling key by the pen input, i.e., a pen. 
[0004] 

[Problem(s) to be Solved by the Invention] However, since a screen is movable only in which direction 
of the upper and lower sides and right and left by the approach by the scrolling key and gesture of the 
above-mentioned former, it is difficult to make the location which a user wants to see on a screen scroll 
exactly. 

[0005] For example, when it was said that he wants to bring a certain location on a screen in the center, 
there was a problem that having to make it move in the combination of up-and-down migration and 
migration on either side, and moving a screen to a desired location took time amount very much. 
[0006] This invention was made in consideration of the above-mentioned point, and aims at offering the 
information processor of a pen input method which can move a screen to the specified location quickly 
and exactly by the input of gesture. 
[0007] 

[Means for Solving the Problem] In the information processor of the pen input method to which a 
coordinate input unit is prepared corresponding to a display screen top, and, as for this invention, 
performs a pen input with this coordinate input unit The gesture input means which carries out the pen 
input of the gesture which directs the scroll point in the screen location which becomes a moved 
material, A recognition means to recognize the migration place of the gesture inputted by this means, It 
is characterized by **(ing) a means to calculate the movement magnitude for moving the point that the 
above-mentioned gesture was inputted to the migration place recognized by the above-mentioned 
recognition means, and the display means which moves to a directions location and carries out a screen 
display of the point that the above-mentioned gesture was inputted according to the movement 
magnitude calculated by this means. 
[0008] 
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[Function] When scrolling the display screen, the gesture which directs scrolling of the "upper right", 
the "lower right", a "center", the "upper left", the "lower left", etc., etc. with a pen is inputted. In this 
case, gesture is inputted into the screen location which becomes a moved material. If the gesture for this 
scrolling is inputted, while the coordinate of the inputted location will be searched for using the 
information from coordinate input devices, such as a transparence tablet, the contents of directions of 
scrolling are recognized with reference to the dictionary for gesture recognition. Recognition of the 
contents of gesture calculates the movement magnitude to the location directed by gesture from the 
above-mentioned gesture input point. And according to this movement magnitude, it is moved to the 
location directed by gesture and a gesture input point is displayed on a screen. 
[0009] Therefore, the gesture which directs scrolling can be scrolled in the location of the request of a 
screen only by only carrying out a pen input. 
[0010] 

[Example] Hereafter, one example of this invention is explained with reference to a drawing. 
[001 1] Drawing 1 is the blocl$: diagram showing the configuration of the information processor of the 
pen input method concerning one example of this invention. In drawing 1 , 1 is CPU which manages the 
whole control and ROM2, the various dictionaries 3, RAM4, the display controller 5, VRAM6, the 
tablet controller 7, and an external interface 8 are connected to this CPU1 through a bus line BUS. 
[0012] The above ROM 2 is read-only nonvolatile memory which stores the program and the various 
data for controlling CPU1. Moreover, programs of recognition of a handwriting alphabetic character and 
gesture, such as recognition and executive operation, are also stored in this ROM2. 
[0013] Various dictionaries, such as a dictionary for performing processing to the dictionary for 
recognizing the dictionary for recognizing a handwriting alphabetic character and the inputted gesture as 
a dictionary 3 and the recognized gesture, are formed. It is [0014] from the location specified as the 
above-mentioned dictionary for gesture recognition by the gesture 1 1 for scrolling, for example, a pen, 
with various gesture. 
[External Character 1] 

nm*t*&^o»Mii6i5ttz r+j 

[0015] The data for recognizing the gesture of ** are registered. That is, data required for recognition 
are extracted and registered into the dictionary for gesture recognition from the form of gesture. 
Moreover, the data for performing processing to the recognized gesture are registered into the dictionary 
for gesture processing. 

[0016] RAM4 is memory which is used since CPU1 saves various data temporarily and which can be 
written. The buffer for gesture registration is also formed in this RAM4. 

[0017] The display controller 5 makes a display panel 9, for example, the LCD panel, display the 
contents of VRAM6 on the bottom of control of CPU1. VRAM6 is memory which saves the contents 
displayed on the LCD panel 9 and which can be written, and is controlled by CPU1 . 
[0018] The coordinate input device 10, for example, a transparence tablet, is formed in the front face of 
the above-mentioned LCD panel 9 in piles. This transparence tablet 10 is connected to the tablet 
controller 7 with the pen 1 1 for data inputs. The above-mentioned transparence tablet 10 detects the 
location pushed with the pen 1 1, and inputs the detected location (coordinate) information into the tablet 
controller 7. The above-mentioned pen 1 1 equips a nib with a switch, when a nib is touched at the LCD 
panel 9, it switch-turns on, and when it detaches, switch-off is carried out and the ON / off information 
on the switch are sent to the tablet controller 7. 

[0019] This tablet controller 7 controls the transparence tablet 10 and a pen 1 1, and transmits the 
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positional information of a pen and the switch information from a pen 1 1 which the transparence tablet 
10 detected to CPU1. This CPU1 acquires the information on the transparence tablet 10 sent from the 
tablet controller 7, or a pen 1 1, controls the display controller 5 and VRAM6, and displays information 
required for the LCD panel 9. 

[0020] Drawing 2 shows the example of the document preparation screen where the LCD panel 9 is 
displayed. As shown in drawing 2 , the viewing area 21 of the document which the upper part and the 
center section of the screen drew up, and the lower part serve as the edit field 22. The above-mentioned 
document viewing area 21 serves as the input area of gesture, and if a notation, an alphabetic character, 
etc. are written to this field with a pen 1 1, recognition processing of it will be carried out as gesture. 
[0021] On the other hand, while the key which shows various kinds of functions, such as a "single 
kanji", "selection/activation", and a "tooth space", is displayed, the recognition next candidate field 24 
which shows the next candidate of the alphabetic character input frame 23 and a recognition alphabetic 
character is displayed on the edit field 22. Only when an alphabetic character is inputted by the pen 1 1 in 
the above-mentioned alphabetic character input frame 23, recognition processing is carried out as an 
alphabetic character. If the alphabetic character inputted into the above-mentioned alphabetic character 
input frame 23 is decided (i.e., if "selection/activation" key is specified with a pen), the input-statement 
character will be displayed on the location specified by the cursor 25 of the document viewing area 21 . 
[0022] Moreover, the input mode at that time, the contents of formatting, etc. are displayed on the 
lowest line of the above-mentioned edit field 22. 
[0023] Next, actuation of the above-mentioned example is explained. 

[0024] When drawing up a document by the alphabetic character input, an alphabetic character is 
inputted with a pen 1 1 in the alphabetic character input frame 23 in drawing 2 . If an alphabetic 
character is inputted in this alphabetic character input frame 23, CPU1 will be judged to be that to which 
the alphabetic character input was performed, and recognition processing to an alphabetic character will 
be performed with reference to a dictionary 3. 

[0025] And when scrolling a screen by the gesture input in the middle of creation of the above- 
mentioned document, the gesture of scrolling is inputted into the document viewing area 21 using a pen 
1 1 . If an input with a pen 1 1 is performed to the document viewing area 2 1 , CPU1 will be judged to be 
that to which the gesture input was performed, the contents of gesture will be recognized with reference 
to the dictionary for gesture recognition formed in the dictionary 3, and processing which corresponds 
according to the contents of recognition will be performed. 

[0026] The gesture "+" which directs migration in the center in the location at the lower right of a screen 
is inputted to move the location at the lower right of the document viewing area 21 to middle of the 
screen now, as shown in drawing 3 (a). CPU1 is step Al of drawing 4 first, when an input with a pen 1 1 
is performed to the document viewing area 21. Gesture is recognized so that it may be shown, it judges 
whether the gesture for scrolling was inputted, and if it is not directions of scrolling, other processings 
according to the directions will be performed. 

[0027] When the gesture for scrolling is inputted, CPU1 searches for the coordinate of the inputted 
location using the information from a pen 1 1 and the transparence tablet 10 (step A2), and judges further 
any of the "upper right", the "lower right", a "center", the "upper left", and the "lower left" the contents 
of directions of scrolling are (step A3). 

[0028] or [ that there are allowances to move the specified location to the upper right from the relation 
between the set-up format and the drawn-up document if the contents of directions of scrolling are the 
"upper right" ]--**** is judged (step A4) and it judges whether "if it is the lower right", migration at 
the lower right is possible for the contents of directions (step A5). Similarly, even when other scrolling 
directions are performed, it judges whether a screen is movable to the directed location (step A6 -A8). 
[0029] When document information is movable to the location by which scrolling directions were 
carried out, count for moving is performed (step A9 -A 13), in case migration processing, i.e., the 
document information currently held at RAM4, is written in VRAM6 according to the count result, the 
write-in location is moved and a screen display of the result is carried out (step A14). In addition, above- 
mentioned step A4 -A8 When it is judged that it cannot move to the directed location, a current display 
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condition is maintained or it moves to a possible location in a screen. 

[0030] As shown in above-mentioned drawing 3 (a), when the gesture "+" which moves the location at 
the lower right of the document viewing area 21 to middle of the screen is inputted, this gesture "+" is 
step A3. It is recognized and is step A6. It sets and it is judged whether migration in the center is 
possible. And count for moving to a center at step Al 1 is performed, migration processing of the screen 
is carried out according to the count result, and as step A 14 shows to drawing 3 (b), the screen after 
migration is displayed. 

[003 1] The concrete processing in the case of moving hereafter the location specified with the pen 1 1 to 
middle of the screen is explained. Drawing 5 shows the relation between the field 3 1 of a whole 
sentence chapter, and the field 33 newly displayed by the field 32 and migration processing which are 
displayed now, and drawing 6 shows the flow chart which performs migration processing to middle of 
the screen. 

[0032] As shown in drawing 5 , the coordinate of the upper limit on the left-hand side of the field 3 1 of a 
whole sentence chapter (0 0), The coordinate of the point B that (xl, y 1), and the gesture "+" that directs 
migration to middle of the screen were inputted in the coordinate of the center A of the current viewing 
area 32 (x2 and y2), The coordinate of the starting point D of (x3, y3), and the new viewing area 33 for 
which it asks is set to (x4 and y4) for the coordinate of the starting point C of the current viewing area 
32 (left-hand side upper limit). 

[0033] When the gesture "+" which directs migration to middle of the screen with a pen 1 1 is inputted, 
CPU1 is step Bl first. Using the information from a pen 1 1 and the transparence tablet 10, the 
coordinate (x2 and y2) of the point B that gesture fl +" was inputted is searched for so that it may be 
shown, subsequently, the difference a of the coordinate (x2 and y2) of an input point B, and the 
coordinate (xl, y 1) of Center A, i.e., the difference in an x-coordinate, and the difference b in a y- 
coordinate - a degree type ~ it asks by a=x2-xl b=y2-y 1 (step B-2). 

[0034] next, c (x-coordinate) and d (y-coordinate) used as the coordinate (x4 and y4) of the starting 
point D of the new viewing area 33 - the coordinate of the starting point C of the current viewing area 
32 - and (x3 and y3) above-mentioned step B-2 It asks by degree type c=x3-ad=y3-b using the value of 
a and b for which it asked (step B3). 

[0035] And the value of c and d for which it asked as mentioned above confirms whether enter in the 
field 3 1 of a whole sentence chapter, first - since it is in a field 3 1 if the value c of an x-coordinate 
judges whether it is larger than "0" (step B4) and is larger than "0" - the value of c - coordinate x4 
****** _ since it is out$ ife a figjj 3 1 if i t sets up ( step 35) an( j i s smaller than "0" - coordinate x4 **** 
- "0" is set up (step B6). next - since it is in a field 3 1 if the value d of a y-coordinate judges whether it 
is larger than "0" (step B7) and is larger than "0" - the value of d - coordinate y4 ****** - since it is 
outside a field 3 1 if it sets up (step B8) and is smaller than "0" - coordinate y4 **** - "0" is setup (step 
B9). 

[0036] Since the coordinate (x4 and y4) of the starting point D of the new viewing area 33 is searched 
for as mentioned above, the field 32 by which it is indicated by current is moved to the new viewing 
area 33. Thereby, the B point specified with the pen 1 1 comes to be located in the center of the new 
viewing area 33. In addition, step B4 Or step B7 When the value of c and d is judged to have crossed the 
field 3 1 of a whole sentence chapter, the current viewing area 32 moves to the new viewing area 33 in 
the possible range. 

[0037] Although the above explained the case where the specified point was moved in the center of a 
screen, in addition when locations other than a center are specified, it can move similarly. 
[0038] In addition, the class of scrolling to direct is not limited to the above-mentioned example, and 
can set up scrolling directions of arbitration. 

[0039] Moreover, although the above-mentioned example showed the case where the scroll point was 
set up by gesture, for two points of arbitration can be specified and it can also scroll. 
[0040] The case where input the gesture of scrolling for two points and processing in the case of 
specifying for two points of this arbitration and scrolling is performed hereafter, and the case where it 
carries out by inputting the gesture in scrolling mode are explained. 
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[0041] Drawing 7 is a flow chart which shows the example of processing in the case of inputting the 
gesture of scrolling for two points with a pen 11, and scrolling. When performing scrolling for these two 
points, first, the gesture of scrolling is inputted for two points and the tap of the location to move is 
carried out with a pen 1 1 after that. 

[0042] When gesture is inputted by the pen 1 1, it is step CI first. It judges whether it is the gesture of 
scrolling for two points, and if it is not the gesture of scrolling for two points, other processings to the 
gesture will be performed. If it is the gesture of scrolling for two points, the coordinate of the location by 
which the pen input was carried out will be searched for (step C2). 

[0043] And if it stands by until the tap of the migration place is carried out with a pen 1 1 (step C3), and 
the tap of the migration place is carried out, the coordinate of the location by which the tap was carried 
out will be searched for (step C4), and it will judge whether it can move to the location (step C5). 
Although processing will be ended as it is if migration is impossible, if migration is possible, it is step 
C2. The coordinate and step C4 of the obtained migration origin Based on the coordinate of the obtained 
migration place, processing for migration which was explained by above-mentioned drawing 6 is 
performed (step C6). After performing this migration processing, that result is displayed on a screen 
(stepC7). 

[0044] For two points of arbitration can be scrolled by the above processing. 
[0045] Next, the processing in the case of inputting the gesture in scrolling mode with a pen 1 1, and 
scrolling is explained according to the flow chart of drawing 8 . When specifying this scrolling mode 
and performing scrolling for two points, first, the gesture in scrolling mode is inputted with a pen 1 1, the 
tap of the location of a moved material is carried out after that, and, subsequently the tap of the location 
of a migration place is carried out. 

[0046] When gesture is inputted by the pen 1 1, it is step Dl first. It judges whether it is the gesture in 
scrolling mode, and if it is not the gesture of scrolling for two points, other processings to the gesture 
will be performed. If it is the gesture of scrolling for two points, it will stand by until the tap of the 
location which becomes next a moved material is carried out with a pen 1 1 (step D2). When the gesture 
for ending scrolling mode is inputted while [ this ] standing by, that gesture is recognized and scrolling 
mode is ended (step D3). Step D2 The coordinate of the location by which the tap was carried out when 
thing detection was carried out to which the tap of the location of a moved material was carried out is 
searched for (step D4). 

[0047] Furthermore, it stands by until the tap of the migration place is carried out with a pen 1 1 in this 
condition (step D5). When the gesture for ending scrolling mode is inputted while [ this ] standing by, 
that gesture is recognized and scrolling mode is ended (step D6). 

[0048] And the above-mentioned step D5 If it detects that the tap of the migration place was carried out, 
the coordinate of the location by which the tap was carried out will be searched for (step D7), and it will 
judge whether it can move to the location (step D8). If migration is impossible, it is step D2. It returns, 
and again, it stands by until the tap of the moved material is carried out. The above-mentioned step D8 
When it is judged that it can move, it is step D4. The coordinate and step D7 of the obtained migration 
origin Based on the coordinate of the obtained migration place, processing for migration which was 
explained by above-mentioned drawing 6 is performed (step D9). After performing this migration 
processing, that result is displayed on a screen (step D10). 

[0049] As mentioned above, in scrolling mode, for two points of arbitration can be specified and it can 

scroll. 

[0050] 

[Effect of the Invention] Since the screen was moved to the location specified by the gesture or the 
location directed by the tap of a pen according to this invention when the gesture for scrolling was 
inputted as a full account was given above, a screen can be moved to the specified location quickly and 
exactly by the input of gesture, and creation of a document, edit processing, etc. can be performed 
efficiently. 
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** NOTICES* 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] In the information processor of the pen input method which a coordinate input unit is prepared 
corresponding to a display screen top, and performs a pen input with this coordinate input unit The 
gesture input means which carries out the pen input of the gesture directed for moving display 
information to middle of the screen in the screen location which becomes a moved material, A means to 
calculate the movement magnitude for moving the input point of that gesture to middle of the screen 
when the gesture which directs scrolling with this means is inputted, The information processor of the 
pen input method characterized by providing a display means to move and display the point that the 
above-mentioned gesture was inputted according to the movement magnitude obtained by this means on 
middle of the screen. 

[Claim 2] In the information processor of the pen input method which a coordinate input unit is prepared 
corresponding to a display screen top, and performs a pen input with this coordinate input unit The 
gesture input means which carries out the pen input of the gesture which directs the scroll point in the 
screen location which becomes a moved material, A recognition means to recognize the migration place 
of the gesture inputted by this means, A means to calculate the movement magnitude for moving the 
point that the above-mentioned gesture was inputted to the migration place recognized by the above- 
mentioned recognition means, The information processor of the pen input method characterized by 
providing the display means which moves to a directions location and carries out a screen display of the 
point that the above-mentioned gesture was inputted according to the movement magnitude calculated 
by this means. 

[Claim 3] In the information processor of the pen input method which a coordinate input unit is prepared 
corresponding to a display screen top, and performs a pen input with this coordinate input unit The 
gesture input means which carries out the pen input of the gesture of scrolling for two points in the 
screen location which becomes a moved material, A means to calculate the movement magnitude for 
moving the point that gesture was inputted by this means, to the location by which the pen tap was 
carried out, The information processor of the pen input method characterized by providing the display 
means which moves to the above-mentioned pen tap location, and carries out a screen display of the 
point that the above-mentioned gesture was inputted according to the movement magnitude calculated 
by this means. 

[Claim 4] In the information processor of the pen input method which a coordinate input unit is prepared 
corresponding to a display screen top, and performs a pen input with this coordinate input unit The 
gesture input means which carries out the pen input of the gesture in scrolling mode, The information 
processor of the pen input method characterized by providing a means to calculate the movement 
magnitude of the migration origin directed by the pen tap, and migration Sakima, and a display means to 
move and display a screen according to the movement magnitude calculated by this means when gesture 
is inputted by this means. 

[Claim 5] The display screen-rolling approach characterized by scrolling a display screen according to 
this recognized result after being the information processing approach of a pen input method, inputting 
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' the gesture which directs scrolling of a display screen from the gesture input means and having 
recognized the class of inputted gesture with the recognition means. 

[Claim 6] The display screen-rolling approach which is the information-processing approach of a pen 
input method, inputted the gesture which directs scrolling of a display screen from a gesture input 
means, and was characterized by scrolling ****** for a display screen so that the location where the 
movement magnitude of the location of the display information which indicates by central was 
calculated, and said gesture was inputted may become in the center of a display screen when the class of 
inputted gesture is a central display. 



[Translation done.] 
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